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Abstract. In developing the network management systems often encountered a situation where there is a 
need to deal with malicious intrusion attempts aimed at obstructing the work. In this case, methods of management 
based on fluid models and a discrete controlled random walk model requires certain changes. In this work a 
generalization of the usual models of single server queue which can describe the attacking action and behaviour of 
the system of protection is presented. Formulation and analysis of the problem are proposed. There are conditions 
found under which the game can be finished. 

Introduction 

Areas where one can apply network models are very different - information networks, 
telecommunications, gas transportation and energy systems, distributed production processes. 
Information network applications are especially important. Today networks are related to almost 
all sides of human activity. As a result, security and reliability of information flows directly 
affect the quality of service, efficiency and overall economic development of entire industries. 
Networks complexity and interconnections are growing constantly. Today most of organizations 
depend on reliable working of the information networks. On the other hand, the vulnerability of 
networks is also increasing every year. This is due mainly to the fact that more potential 
attackers have access to resources with networks growing. 

Nowdays, network is a complex (often nonlinear) system with significant unknown 
disturbance. Our infiuence possibilities are constrained by some parameters called control 
parameters. An important point of control theory is its fiexible approach to modeling. We 
typically consider a linear, deterministic model. In the work [4] said an idea that the control 
system should be simplest model that capture essential feature of the system to be controlled. 

Let us define network terminology. The network here consists of a finite set of nodes. 
Each node contains a set of buffers. These buffers can hold finite amount of packets. One or 
more servers process packets at a given buffer. 

A general stochastic model defined in the work [4]. Let us make a short summary. 

Define the vector valued queue-length process Q that evolves on i?f . The vector valued 

cumulative allocation process Z eR'^" . The z'th component of Z{t), denoted Z.(t) , is equal to 

the cumulative time that the activity i has run up to time t. The evolution of the queue-length 
process is described by the vector equation, 
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Q{t) = Q{t,) + B{Z{t)) + A{t),t>Q. (1) 

where the process A may denote a combination of exogenous arrivals to the network, and 
exogenous demands for materials from the network. The function B represents the effects of 
(possibly random) routing and service rates. 

The cumulative allocation process and queue-length process are subject to several hard 
constraints: 

(i) The queue-length process is subject to the state space constraint, 

?>0, . (2) 

(ii) The control rates are subject to linear constraints, 

C{Z{t,) - Z{t,)) < {t, -t,)-e, Z{t,) - Z(t,) >0,0<t,<t„ (3) 

where the constituency matrix C is a N^xN^^ matrix, e = e R'^" . 

Stochastic models such as (1) have been by far the most popular in queuing theory. An 
idealization is the linear fluid model, described by the purely deterministic equation, 

qit) = q(t,) + Bz(t) + a(t-t,), t>0, q{t) e < . (4) 

where the vector q{t) evolves in the state space i?f and the (cumulative) allocation 
process z{t) evolves in i?f " . We again assume that z(0) = , and for each < < 

C[z{t,)-z{t,)\<{t,-t,)-e. (5) 
z{t,)-z{t,)>0. 

The fluid model can also be described by the differential equation 

— = Bu + a, (6) 

where control u{t) a is measurable function such that Cu<e, u{t)>0. We choose a 
control function u{t) in purpose of minimizing vector q(t) under several special conditions (e.g. 
for minimal time). 

Solution of (6) can be found using following formula: 

t 

q(t) = q{tf^) + ^Bu{x)dx + a(t-tf)) . 

h 

t 

Taking into account z{t) = |m(t)c/t we obtain that expression above is equal to (4). Two 

to 

different symbols are used to denote the state processes for the stochastic and fluid models since 
much of the development to follow is based on the relationship between the two models, hi 
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particular, the fluid model can be interpreted as the mean flow of the stochastic model (1) on 
writing, 

G(0 = Q{Q + A(t) + B(Z(t)) = Q{Q + BZ(t) + a(t - 1,) + N(t) , t>0, (7) 

where a and B are interpreted as average values of A and B , and 

Nit) = [Ait) - ait - 1,)] + [BiZit)) - BZit)] . 




Figure 1 . Stochastic and fluid model. 

Typical assumptions on the stochastic model (7) imply that the mean of the process 
{Nit)} is bounded as a function of time, and its variance grows linearly with t. Under these 
conditions (1) can be loosely interpreted as a fluid model subject to the additive disturbance 
Nit) . Example of behavior is presented on Fig. 1. 

The theory of conflict controlled processes covers one of the divisions of mathematical 
theory of control which examines objects dynamic under conflict and uncertainty conditions. 
This conditions or factors may be different (technical problems, network topology bottlenecks, 
malicious bots) but flnally they try to interrupt normal system's work. 

Consider a conflict controlled object whose dynamics is described by the linear 
differential equation: 

dqit) 



dt 



^ Aqit) + Buit) - Cvit) + ait) 



(8) 



where qit)^Rl is an vector of an object state, uit)eU R" is a parameter of flrst player, 
v(^) eV c^R' is a parameter of second player, a(-) :R ^ R" is a vector function of packets 
arriving. A,B,C - real matrixes of orders nxn, nxm i nxl , respectively. A game (8) is 
played as follows: at moment of time t>0 players set their control functions v(^) and uit) . 
Game is flnished when qit) = . First player tries to finish game as soon as possible. On the 
contrary, second player tries to counteract with all his recourses. If ait) = then equation (8) 
turns to classic conflict-controlled process [6] 

dqit) 



dt 



Aqit) + Buit) -Cvit) 



(9) 
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Problems of conflict processes of two players (9) are investigated in many works (e.g. [6 
- 8]). In this work we focus on the first direct method of Pontryagin [7, 8]. 
2. Linear game model of the single server queue 

The single server queue is a useful model for a dynamic investigation of very different 
systems. In this chapter we introduce an extension of the fluid model [4] in the case of conflict 
process. Let us consider dynamic system (Fig. 2). This system defined for an initial condition 
?(0 = (?i(05 ^2(0) ^ by the system of linear equations: 

(t) = a(t) + A: • ^2 (0 ~ ^1 (0 5 
q,it) = vit)-u,it), t>0. (10) 
Phase state is described by the phase vector q(t) = {q^^it^q^it)) e , where q^{t) e is 
the queue length at time t . 

The queue length is subject to the linear phase constraint 

0<^i(0<<"'forall ^>0. 
Parameter q^ify&R^ is associated with the attacker player which trying to overwhelm 
our network (or maximize q^{t) in other words) using control parameter v{t), v{t) > 0, v{t) < v . 
By choosing v{t) at time t attacker sets attack power ( q^2(0 ) which is subject to the linear phase 
constraint 

0<g2(0 for all t>Q. 

Parameter ^2(0 influences on queue q^{t) with a coefficient A: > . 

The other player - defender - has a control vector u{t) = {uy{t),U2{t)) . He divides his 
control resources between two directions: Uy{t) - for service of the arrived packets, ^2(0 - for 
counteraction of the attacker activity. 

Control parameter u{t) is subject of following constraints 

Mi(0^0, 1/2(0^0, Mj(0 + "2(0^1^, for all ^>0. 



a(0 Buffers 



Server 
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Figure 2. Single server queue with counteraction 
Suppose that defender has information about a(t) , v(t) and q(t) at time t. 

Function a( ) -.R^R" describe packets arrival service at time t . Suppose the following 
assumptions hold: 

(i) 0<a(0<a„,,foralU>0; 

(ii) a(t) - continuous function. 

If ^2(0) - ^(0 = 0, CL(t) = a„3^, then equations (10) are famous single server fluid 
model []. 

Let us recall several results about the fluid model. The fluid model is called stabilizable 

if, for any q^{0) , there exists strategy Mj(?) and time T>0 such that 

r 

q,(T) = q,(0) + J(a„,, - u,('z))dx = . (11) 


The minimal draining time, denoted T*{q^{0)), is defined for q^(0)GR as the smallest 
T>0 satisfying (11). 

For two states ^1(^1) and ^1(^2) the minimal time to reach ^1(^2) from qiit^) over all 
strategies is denoted T{q^{t^),q^{t2)) . 

(X 

This model is stabilizable if and only if — sis^ < 1 . Time optimal strategy gives by 



following formula 



[ u, q. (t) > 

u(0 = (t/,(0,0), where ui(0 = r' ^. (12) 

10, ^i(0 = 



This is so-called non-idling policy. Minimal draining time in this case is 

r-(,,(0)) = ^<°L. 

Our task is to obtain similar result for the equation (10). More formally, we should find 
conditions for q^, such that following statement holds: 

(i) r*(go)<+co. 

(ii) There are exists an admissible strategy u{t,q(t),v{t)) such that q{T*{qQ)) = 0, 
where q(t) is the solution of (10). We will call this strategy u{t,q{t),v{t)) - the 
solution of game (10). 

Note that this result must be achieved over all an admissible functions v{t) . 
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Let us write equations (10) in more general form. Denote A = 



^0 k'^ 



then 



qit) = Aqit) + 



(13). 



Control sets are respectively U = {w e i?^ : Wj + ^ and V = {v &Rl^.v^< a^^^, Vj < v} . 
Terminal set is M = {(0,0)} . Let us solve this problem using idea of the first direct method of 
Pontryagin [7, 8]. Let us consider the Pontryagin map Gi{t) = 

f]{U -v)={x&R^ ■.x,+X2<[i-v-a^J = 



= co{(0,0), (n - V - a„,,,0), (0, n - V - J} . 

Since e^' is linear operator, we see that 

f](e-U-e-v) = e^'f]{U-v). 

veF veF 

co(0 = co{(0,0), (n - V - a„,„0), (ktin - v - a„ J, n - v - a„ J} . 
Condition 1, Mapping (x>(t) for alH > 0. 
Condition 1 holds for all ^ > , if n > v + a^^^. 

As shown in [7] by M. Nikolsky (for game (10) without phase constraints) if condition 1 

T 

holds and exists time T>0 such that e^^^q^ e j(o(T)dT then the solution u(t) could be 



constructed. 

Condition 2. For initial state (g'i(O), 5^2(0)) a following inequality holds 

- ^i(O) > r(g,(0))' . 

2(n-v-a„J 

Theorem, Consider the game (10) satisfying conditions 1,2. Then, there are exists the 
solution u{t) such that q{T*{qQ)) - 0. 
Proof. 

Without loss of generality q(0) ^ (0,0) . Let us define moments of time 

T^=wm{t>0:q^{t) = 0}; 
T2 =min{f>0:g'2(0 = 0}. 

Then, define u(t) 

[(a(0,H-a(0), tG[0,T,] 
u(t) = < (14) 
[(^-v(0,v(0), te[T„T,] 
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First we show then the strategy u(t) is admissible. The strategy u(t) is defined for all 
t>0 and Ui{t) + WjCO = M- . 

Since condition 1 holds, it follows that Ui{t) > , MjCO ^ for all ^ > . 
Substituting (14) into (10) we obtain 
For teiOJ^] 

q,it) = k ■ q^it) , 
q^(t)^vit) + a(t)-ii. 

For t e[T2,T^] 

gi(0 = v(0 + a(0-^, 
^2(0 = 0. 

Denote |j, - a^^^ - v as e , then 

q2it)<-£, 
q,(t)<qM-^t- 

From the last statement follows that ^2(0 = foj" moment of time t<T* = ^^^^^ . 

8 

Subsequently, we obtain that < Tj* . 
Similarly: 

t 

qiit) = qM + lkq2ix)dx 



( 

^i(0 = ^i(O) + kq2(0)t -jk(v(z) + a(x) - [i)dz 



^1 (0 < ^1 (0) + kq2 (0)t - ke - 



2 

S S 

,,(r,).„(0)4M!))l 

2 s 

Last statement obtained by using condition 2. In the moment of time control switches. 
Since q2{t)-Q , ? > , we can consider only q^{t) 



qiiO = qiiTi) - |(v(t) + a(T) - \i)dx , 



q,{t)<q,{T^)-z{t-T^)., 



Therefore, we have following estimation for the time Zj 



■ + — 
s 2 



£ s 2 



V e ; 



V s y 

This completes the proof of Theorem. 
4, Experimental modeling 

Let us illustrate obtained result on the example. Consider the following model: 

^i(0 = a + ^2(0-Wi(0, 
q^{t) = v-u^{t), t>0. 





Figure 3. Fluid model without control 
On figure 3 we can see dynamic of phase variables qi{t) , q^it) without control u{t) . 
Using control defined in previous chapter 

f(a,)i-a), t&iOJ^] 
u{t) = < 

[(^-v,v), te[T2,Ti] 

we can satisfy condition q{t) = {0} at the latest at moment of time T^ (Figure 4.). 




50 100 




Figure 4. Controlled fluid model 
Note that initial state qji^) imply growing initial queue state on the value 

k (q2(0)f 
2 (|i-v-a„J ■ 



Conclusion 

In this work we consider the single server model with counteraction. We extend the 
classic fluid model using results from the theory of conflict controlled processes. Our new model 
describes conflict processes on the networks. For that model we have defined two players - an 
attacker and a defender. Behavior of the system depends on strategies of these players. 

We formulated conditions that guarantee possibility of winning of one player. This fact 
proved by the main theorem. We have illustrated theoretical results on the experimental 
computational modeling. 
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